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The  objective  of  this  project  is  to  derive  global  convergence  theorems  and  practical  numerical 
algorithms  for  probability-one  homotopies  in  the  areas  of  constrained  optimization,  large  sparse 
unstructured  systems  of  nonlinear  equations,  control  design  and  analysis,  and  Hi / H^  dis¬ 
turbance  rejection  controls.  The  emphasis  is  on  useful  convergence  theorems  expressed  in  terms 
of  conditions  on  the  original  problem  rather  than  conditions  on  the  derived  problem.  Important 
applications  are  considered  as  a  guide  to  what  theoretical  questions  should  be  asked. 

The  combined  H2/H°°  model  reduction  problem. 

The  problem  of  finding  a  reduced  order  model,  optimal  in  the  H 2  sense,  to  a  given  system 
model  is  a  fundamental  one  in  control  system  analysis  and  design.  The  addition  of  a  H 00  constraint 
to  the  H 2  optimal  model  reduction  problem  results  in  a  more  practical  yet  computationally  more 
difficult  problem.  Several  order  reduction  techniques  had  been  proposed  for  approximating  the 
frequency  response  of  a  given  system.  For  example,  frequency  weighting  had  been  studied  by  D. 
F.  Enns  in  conjunction  with  balancing  (B.  C.  Moore).  Moreover,  Hankel  norm  reduction  had 
been  shown  to  have  fundamental  ramifications  for  frequency  domain  approximation.  There  were 
theoretical  formulations  for  the  combined  H2 / H 00  model  reduction  problem,  but  there  had  been 
no  serious  numerical  studies. 

The  combined  H2  jH°°  model  reduction  problem  is  formulated  as:  given  the  controllable  and 
observable,  time  invariant,  continuous  time  system 

x(t)  =  Ax(t)  +  BDu(t),  y(t)  —  C  x(t), 

where  t  G  [0,  oo),  A  €  EnXn  is  asymptotically  stable,  B  G  Enxm ,  C  G  Elxn ,  D  G  Emxp  ( m  <  p ) 
and  the  input  Du(t)  is  white  noise  with  symmetric  and  positive  definite  intensity  V  =  DDT,  find 
a  nOT-th  order  model  ( nm  <  n ) 


®m(0  —  Am  a;TO(t)  T  Bm  Du(t ),  J/m(0  —  Cm 


where  Am  G  EnmXnm ,  Bm  G  E”mXm,  Cm  G  ElXrim ,  which  satisfies  the  following  criteria: 

(i)  Am  is  asymptotically  stable; 

(ii)  the  transfer  function  of  the  reduced  order  model  lies  within  7  of  the  transfer  function  of  the 
full  order  model  in  the  Hc o  norm,  i.e.,  ||R(s)  —  Rm(s)||oo  <  7  where  H(s)  =  EC(sIn  —  A)_1BD, 
Hm(s )  =  ECm(sIm  —  Am)~iBmD,  7  >  0  is  a  given  constant,  E  G  Eqxl  ( q  >  l)  is  a  given  constant 
matrix;  and 


1. 1  i  u  1  iU  }  or 

Special 


□  □ 


(iii)  the  H 2  model  reduction  criterion  J(AmyBm}Cm)  =  limf_+oo£  [( V  -  2/m)T^(2/  —  Vm )]  Is 
minimized,  where  £  is  the  expected  value  and  R  =  ETE  is  a  symmetric  and  positive  definite 
weighting  matrix. 

Several  approaches  based  on  homotopy  methods  had  been  proposed.  The  issues  were  the 
number  of  degrees  of  freedom,  the  well  posedness  of  the  finite  dimensional  optimization  problem, 
and  the  numerical  robustness  of  the  resulting  homotopy  algorithm.  Homotopy  algorithms  based  on 
several  formulations  —  input  normal  form;  Ly,  Bryson,  and  Cannon’s  2x2  block  parametrization; 
a  new  nonminimal  parametrization  —  were  developed  and  compared.  This  represented  an  attempt 
to  design  practical  and  efficient  numerical  algorithms  for  solving  the  combined  H2 /H°°  model 
order  reduction  problem. 

One  of  the  main  conclusions  for  this  study  was  that  the  more  degrees  of  freedom  that  a 
formulation  used,  the  more  robust  was  the  resulting  numerical  algorithm.  The  input  normal  form 
and  Ly  form  homotopies  were  very  efficient  for  the  combined  H2 /H^  model  reduction  problems. 
However,  they  might  fail  to  exist  or  be  very  ill  conditioned.  The  over-parametrization  formulation 
solved  the  ill  conditioning  issue,  but  introduced  singularity  at  the  solution  and  might  fail  for  a  high 
dimensional  system,  which  would  inevitably  have  a  high  order  singularity  at  the  solution. 

Another  conclusion  was  that  solving  the  H2  optimal  model  order  reduction  problem  might  be 
well  worth  the  effort  (compared  to  simple  balancing).  The  studies  also  proved  the  worth  of  adding 
the  H°°  constraint.  Finally,  globally  convergent  homotopy  methods  were  a  viable  approach  to  the 
computationally  very  difficult  combined  H2 /H°°  model  order  reduction  problem. 

LQG  control  synthesis  with  an  H°°  performance  bound. 

The  H2  /H 00  mixed-norm  controller  synthesis  problem  provides  the  means  for  simultaneously 
addressing  H 2  and  H 00  performance  objectives.  In  practice  such  controllers  provide  both  nominal 
performance  (via  H2)  and  robust  stability  (via  JT°°).  Hence  mixed-norm  synthesis  provides  a 
technique  for  trading  off  performance  and  robustness,  a  fundamental  objective  in  control  design. 
The  H2/H°°  mixed-norm  problem  has  been  addressed  in  a  variety  of  settings.  The  treatment  by 
Bernstein  and  Haddad  utilized  an  H 2  cost  bound  as  the  basis  for  an  auxiliary  minimization  problem. 
Necessary  conditions  for  optimality  within  a  full-  and  reduced-order  fixed-structure  setting  were 
then  used  to  characterize  feedback  control  gains.  In  related  work  of  Glover  and  Mustafa,  the  H2 
cost  bound  in  the  case  of  equalized  H2  and  H 00  performance  weights  was  shown  to  be  equal  to  an 
entropy  cost  functional.  The  centralized  controller  was  then  shown  to  yield  a  full-order  controller 
that  optimizes  the  entropy  cost.  Despite  the  existence  of  theoretical  formulations,  practical  and 
efficient  numerical  algorithms  for  solving  the  problem  were  still  lacking.  This  study  developed 
numerical  algorithms  for  solving  the  mixed-norm  H2/H°°  problem  addressed  by  Bernstein  and 
Haddad. 

The  problem  can  be  stated  as  follows:  given  the  rc-th  order  stabilizable  and  detectable  plant 

x(t)  -  A  x(t)  +  B  u(t)  +  Diw(t),  y(t )  =  C  x(t)  +  D2w(t),  (1) 

where  A  e  EnXn,  B  €  Enxm ,  C  €  Elxn ,  Dr  €  £nXp,  D2  €  Elxp,  DiD%  =  0,  and  w(t)  is 
p-dimensional  white  noise,  find  a  nc-th  order  dynamic  compensator 

xc(t)  =  Ac  xc(t)  +  Bc  y(t ),  u(t)  =  Cc  xc(t ),  (2) 
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Fig.  1.  Trade-off  curve. 
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Fig.  2.  Homotopy  curve. 
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where  Ac  €  EncXTlc,  Bc  6  EUcXl,  Cc  e  EmXnc,  and  nc  <  n,  which  satisfies  the  following  criteria: 

(i)  the  closed-loop  system  (l)-(2)  is  asymptotically  stable,  i.e.,  A  —  ^  q  ^A°  )  1S  as^mP' 
totically  stable; 

(ii)  the  goo  x  p  closed-loop  transfer  function  H(s)  =  E^sla  -  A)~lD,  from  w(t )  to  z(t )  = 
Eloox(t)+E2oou(t),wheie  Eoo  =  (Eloo  E2ooCc)(Eloo  €  Eq~Xn,E2oo  G  £9~xm,  E^  E2oo  =  0), 

n  —  n  +  nc,  and  D  =  satisfies  the  constraint  ||.ff(s)||oo  <  7>  where  7  >  0  is  a  given 

constant;  and 

(iii)  the  performance  functional  J(Ac,Bc,Cc)  =  ^lim  £  [xT(t)iJia;(t)  +  uT(t)R2u(t)]  is  mini¬ 
mized,  where  £  is  the  expected  value,  R\  —  E^Ei  6  J5"xn  and  R2  =  Ej E2  €  Emxm  (E\  €  EqXn, 
E2  €  EqXm,  EjE2  =  0  )  are,  respectively,  symmetric  positive  semidefinite  and  symmetric  positive 
definite  weighting  matrices. 

Homotopy  algorithms  for  both  full-  and  reduced-order  LQG  controller  design  problems  with 
an  H°°  constraint  on  disturbance  attenuation  were  developed.  The  numerical  algorithm,  based 
on  homotopy  theory,  solved  the  necessary  conditions  for  a  minimum  of  the  upper  bound  on  H 2 
performance.  The  algorithms  were  based  on  two  minimal  parameter  formulations:  Ly,  Bryson, 
and  Cannon’s  2x2  block  parametrization  and  the  input  normal  Riccati  form  parametrization. 
An  over-parametrization  formulation  was  also  proposed.  Numerical  experiments  suggested  that 
the  combination  of  a  globally  convergent  homotopy  method  and  a  minimal  parameter  formulation 
applied  to  the  upper  bound  minimization  gave  excellent  results  for  mixed-norm  H2 /H°°  synthesis 
(see  Fig.  1).  Fig.  1  is  the  trade-off  curve  for  a  reduced-order  LQG  controller  synthesis  problem.  The 
nonmonotonicity  of  homotopy  zero  curves  (see  Fig.  2)  was  demonstrated,  proving  that  algorithms 
more  sophisticated  than  standard  continuation  were  necessary. 

Modified  Riccati  equations. 

Another  prototype  problem  is  the  matrix  Riccati  equation, 


AX  +  XA*  -  XEX  +  R  +  F(X)  =  0, 
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where  F(X)  is  a  symmetric,  low  rank  matrix  function.  Existing  linear  algebra  techniques  for  the 
case  F(X )  =  0  do  not  generalize  well  to  F(X)  ^  0,  and  the  embedding  approaches  proposed  so 
far  assume  X  =  X(A)  rather  than  the  more  general  X  —  X(s),  A  =  A(s)  (where  A  is  the  homotopy 
parameter  and  s  is  arc  length  along  a  homotopy  zero  curve).  This  is  significant,  because  the  latter 
(modern  homotopy)  situation  requires  considerably  more  sophisticated  numerical  linear  algebra 
techniques  than  the  more  restrictive  situation  X  =  A(A)  (continuation).  Using  tensor  products 
and  orthogonal  decompositions,  some  progress  has  been  made  on  parallel  probability-one  homotopy 
algorithms  for  the  Riccati  equation. 
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Consulting  on  homotopy  methods  has  been  done  with  Richard  Erwin,  Kirtland  AFB;  Dr. 
Emmanuel  Collins  and  Dr.  Larry  Davis,  Harris  Corporation,  Melbourne,  FL;  Dr.  Dennis  Bernstein, 
University  of  Michigan,  Ann  Arbor;  Dr.  Alexander  Morgan,  General  Motors  Research  Laboratories, 
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Technology  transfer  to  industry. 

Probability-one  homotopy  algorithms  and  versions  of  HOMPACK  are  in  use  at  General  Mo¬ 
tors  Research  Laboratories  (CAD/CAM,  robotics,  combustion  chemistry,  mechanism  analysis), 
Harris  Corporation  (control  systems),  NASA  Langley  (variable  geometry  truss  design,  integrated 
control-structure  optimization),  and  AT&T  Bell  Laboratories  (circuit  design,  computer  vision). 
The  resultant  programs  from  research  conducted  in  collaboration  with  Emmanuel  Collins  and 
Larry  Davis  of  Harris  Corporation  (control  systems),  Richard  Erwin  at  Kirtland  AFB,  and  Dennis 
Bernstein  at  the  University  of  Michigan  have  been  integrated  into  a  preliminary  version  of  a  MAT- 
LAB  toolbox,  which  has  been  installed  at  Harris  Corporation,  Kirtland  AFB,  the  Interdisciplinary 
Center  for  Applied  Mathematics  (ICAM)  at  Virginia  Tech,  and  at  the  University  of  Michigan. 
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Future  work. 

1.  Homotopy  convergence  theory  for  model  order  reduction  problems  and  reduced-order  con¬ 
trol  problems.  Rigorous  proof  of  convergence  of  the  homotopy  algorithm  is  still  lacking.  Con¬ 
vergence  proofs  will  require  fundamental  theory  of  homotopy  methods  and  exploit  the  specific 
structure  of  control  system  problems. 

2.  Initial  point  selection.  The  present  algorithm  for  choosing  the  initial  point  for  the  mixed 
norm  reduced-order  control  problem  is  not  satisfactory  since  it  leads  to  a  long  homotopy  path. 
More  investigation  is  needed  to  find  an  overall  efficient  numerical  algorithm. 

3.  Parallel  Riccati  equation  solver.  Although  there  are  numerous  algorithms  for  solving 
Riccati  equations,  there  still  remains  a  need  for  algorithms  which  can  be  generalized  easily  to  solve 
variants  of  Riccati  equations  and  which  can  operate  efficiently  on  parallel  machines.  Homotopy- 
based  algorithms  may  be  ideal  for  such  an  application. 

4.  Parallel  code.  Practical  applications  often  lead  to  large  systems  of  equations.  For  these 
systems,  parallel  computers  may  be  the  only  feasible  computational  tool.  Parallel  algorithms  for 
the  combined  H2 / H°°  model  order  reduction  problem  and  the  mixed  norm  control  problem  are 
needed  to  meet  the  computational  demand  of  realistic  applications. 

5.  MATLAB  package.  Considerably  more  time  and  effort  are  needed  to  make  the  MATLAB 
toolbox  resulting  from  this  work  more  portable  and  robust.  New  capabilities  will  also  be  added  to 
this  toolbox. 
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